Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills
نویسندگان
چکیده
This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD) and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses.
منابع مشابه
The Self-formation of Collaborative Groups in a Problem Based Learning Environment
formation of collaborative groups in a the self of the three steps method The aim of this paper is to present problem-based learning environment. The self-formation of collaborative groups is based on sharing of accountability among students for solving instructional problems. The steps of the method are planning collaborative problem solving, self-evaluation of students, and building collabora...
متن کاملA Comparative Analysis on Sony’s Approach to Problem Solving and Decision-Making
Decision making and problem solving are especially important skills for business and life. As an innovation leading corporate, Sony has gradually lost their superiority in innovation and core competences under more and more intensive competition environment. This report is made to investigate Sony current procedure on its solving problems and making decision, analyze approaches and tools used b...
متن کاملA Computational Method for Solving Optimal Control Problem of Time-varying Singular Systems Using the Haar Wavelets
متن کامل
A NOVEL FUZZY-BASED SIMILARITY MEASURE FOR COLLABORATIVE FILTERING TO ALLEVIATE THE SPARSITY PROBLEM
Memory-based collaborative filtering is the most popular approach to build recommender systems. Despite its success in many applications, it still suffers from several major limitations, including data sparsity. Sparse data affect the quality of the user similarity measurement and consequently the quality of the recommender system. In this paper, we propose a novel user similarity measure based...
متن کاملThe Relationship between Family Environment, Social Skills, and Problem Solving among Female High School Students
Possessing social and problem-solving skills is essential for successful performance in life. The family and educational system can equip students with these vital skills. This study was carried out to determine the relationship between the family environment, social skills, and problem solving among female students. The research method was descriptive-correlational and the statistical populati...
متن کامل